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CHAPTER 1 
SORTING AND SORTING NETWORKS 

1.1 Sorting 

The ability to sort a sequence of objects seems to be important in the 
solution of many data processing problems. This thesis deals with a particu- 
lar kind of sorting algorithm called a sorting network; but before discussing 
sorting networks, it will be appropriate to deal with sorting per se . 

Intuitively, to sort is to rearrange a sequence of "values" or "numbers" 
to conform to some order. There are always two orders involved in this 
process; the order implicit in the sequence and the numerical order of the 
values themselves. For example, if each of a sequence of locations in a 
computer memory contains a number, we can talk about sorting the sequence 
of numbers. This is done by changing the locations of the numbers so that 
after the process is completed, the number in location x is less than or 
equal to the number in location y whenever location x precedes location y. 
Note that sorting affects neither the sequence of the locations nor the 
values of the numbers. Rather, it changes the assignment of numbers to 
locations. Definition 1.1.1 generalizes these intuitive notions to deal 
with partially ordered sets. 

Definition 1.1.1 If D and R are sets partially ordered by P and ^, respec- 
tively, and if f is a function from D to R, a permutation n on D sorts f 
(with respect to P ) if 



(Vx, y eD)(TT( X )PTT(y) => f ( x ) ^ f(y)) 

or, equivalent ly, 

(Vx, y€D)(xPy =» f(TT _1 (x)) * f(Tr _1 (y)) 

The function f is called an assignment from the locations of D to the values 
of R. If f is an assignment which is already sorted with respect to P, i.e. 
if f satisfies the condition 

(Vx, y£D)(xPy =» f(x) * f(y)) 

then f is consistent with P. D 

Letting f-g denote the composition of the functions f and g, i.e. f-g(x) = 
g(f(x)) for all x in the inverse image of the domain of g, it is easy to 
see that if tt sorts f with respect to P, then tt • f is consistent with P. 

Example 1.1.2 If D and R are the sets fa,b,c,d) and (0,1,2,3,4], respec- 
tively, with P and < the obvious total orders, then the permutation (abd) (c) 
sorts the assignment f defined by f(a) = f(d) = 0, f(b) = 3, f(c) = 2 
with respect to P because f(TT~ 1 ( a )) = 0, f(rr" 1 (b)) = 0, f(TT -1 (c)) = 2, 



and f(TT" 1 (d)) = 3. 



Of course, the most usual special case of sorting arises when D is 
a finite set, P is a total order, R is a set of numbers, and ^ is the 
familiar total order. If D is not finite or if ^ is not total, it may 
not be possible to sort some kinds of assignments. 



n 



Example 1.1.3 Let D and R both be the set of positive integers, with P 
and ^ the obvious total orderings. The assignment f defined by 

if n is even 
f(n) = 

[l if n is odd 

cannot be sorted because f (n) = for infinitely many n, and therefore a 
permutation TT to sort f could not have TT(n) finite for n odd. □ 

Example 1.1.4 Let D and R both be finite sets, with P any partial order 
on D and ^ the identity relation on R. Then no injective assignment f 
can be sorted unless P is the identity relation on D, for if xPy with 
x £ y, f (tt (x)) = f (tt (y)) is false for every permutation tt. D 

It is clear that if D is finite and P and ^ are a total orders, any 
assignment from D to R can be sorted by an appropriate permutation. 
In fact, P need not be a total order, as the next theorem shows. 

Theorem 1.1.5 Let f be any assignment from a finite set D to a range 
R, with P a partial order on D and £ a total order on R. Then any 
assignment f : D ■+ R can be sorted with respect to P. 

Proof : Let T be a total order on D such that P c T, and let TT sort f 
with respect to T. Then 

(V x , y€D)(xTy =» f(Tr' 1 (x)) < f(Tr" 1 (y))) 
Since P £ T, we have 



(V x , yfD)(xPy ^ xTy) 
and 

(V x , y€D)(xPy =» f(TT _1 (x)) < fCn'^y))) 

so Tr sorts f with respect to P. O 

It will be assumed in what follows that D is a finite set and ^ is a total 
order. It will be useful to let R be some set of numbers, with < the 
familiar total ordering. R will be either a finite set of positive integers, 
the set of all positive integers, or the set of real numbers; most often, 
it will be unnecessary to state explicitly which of these sets R denotes. 
The domain D will usually be a set of numbers, or a set of letters where 
confusion might result from the use of numbers. 

It will also be useful to talk about sets containing all of the sorted 
assignments of a particular kind. 

Definition 1. 1. 6 If P is a partial order on the domain D, then the sets 
A , I , and Z are defined as follows: 

A p = {f: D -> r|(V x , y€D)(xPy => f(x) <■ f(y)) 
L = (f: D->R|f f A p A f is injective} 
Z p = {f: D ■♦ Rlf € A p a Range(f) = (0,1}} 

That is, A is the set of assignments consistent with P, I p is the set of 
injective (one-one) assignments consistent with P, and Z is the set of 
zero-one valued assignments consistent with P. The set of all assignments 
from D to R will be written A_; similarly, I_ denotes the set of all 



injective assignments from D to R, and Z_ will denote the set of all 
zero-one valued assignments from D to R. Thus I = A f~l I_ and Z = 

a p n z = . ^ 

1.2 Sorting Networks 

The familiar algorithms for sorting an assignment f make use of 
two primitive operations: comparison and interchange. For any pair 
of elements x and y in D, a comparison of x and y determines whether 
or not f(x) ^ f(y), and an interchange of x and y transforms f into 
f = tt "f, where tt is the permutation (xy). These two primitive 
operations are combined in the definition of a comparator which can be 
viewed as a kind of sorting operation on a two element domain. 
Specifically, a comparator on x and y performs an interchange of x 
and y if and only if the assignment f has f(x) > f(y). Notice that 
a comparator on x and y transforms an assignment f into an assignment 
f satisfying f'(x) ^ f'(y), so that f ' (x) is the minimum of f(x) 
and f(y) and f'(y) is the maximum of f(x) and f(y). 

Definition 1.2.1 If x and y are elements of domain D, the comparator 
<x,y> is that operation which transforms any assignment f into the 
assignment f = < x,y > (f) given by 

if f(x) < f(y) 
JT^.f if f(x) > f(y) 
where n is the permutation (xy). D 
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A comparator "^K,y > may be represented schematically by an arrow 
from x to y, indicating that the larger of f (x) and f (y) will be 
assigned to y and the smaller of f (x) and f(y) will be assigned to x. 
A composition of comparators can be drawn as a network, with locations 
in D represented by lines drawn from left to right and comparators 
represented by arrows connecting the lines vertically. For example, 
if D is the domain {a,b,c,d} , then the composition of comparators 

<*,b> • <<i,c> -<a,d> -<b,c> • <b,d> 

can be represented by any of the networks depicted in Figure 1.2.1 



" 






V 




3" 


r 


1 .4 


(a) 




'f 


T- 


\ 


f 


" d 


7 


f 


(b) 




<r- ir 


h 




-r^v-c 



Figure 1.2.1 Examples of comparator networks. 
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In Figure 1.2.1, the horizontal lines (often called "wires" by analogy 
with electrical networks) are labeled with the elements of D that they 
represent. For any labeled network, there is exactly one composition 
of comparators that the network represents, and for any composition 
of comparators, there is exactly one labeled network (as long as 
rearranged versions of the same network do not count as distinct.) 

Definition 1.2.2 A comparator network is a composition of comparators. 
If f is an assignment and C is a comparator network, C(f) will denote 
the assignment that f is transformed into by the composition of 
comparators C. If A is a set of assignments, the image of A under a 
comparator network C is written C(A) and defined to be the set 

{c(f)!f € a] n 

Although a comparator network has been defined abstractly as a composition 
of functions called comparators, it is possible to implement a comparator 
as a finite state machine and thus to implement a comparator network as 
a network of finite state machines., This implementation is discussed 
more fully in Chapter 2. 

Definition 1.2.3 If C(A_) = A for some partial order P on D, then C is 
said to sort with respect to P. If T is a total order on D such that 
C(A_) = A^ C is called a sorting network (with respect to T). If C is 
a sorting network with respect to T such that xTy for every comparator 
<x,y> in the network C, then C is called a standard form sorting network. C 1 
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For example, it can be shown that the comparator network described in 
Figure 1.2.1 is a sorting network; in fact, it is a standard form sorting 



network with respect to 



f a 

b 

d ' 
» c 



It is conventional to draw comparator networks with no wire crossings 
and with the wire labeled x above the wire labeled y iff xTy. If this 
is done for a standard form sorting network, all of the arrows will point 
down, so that the arrowheads are redundant and may be omitted. Notice 
that Figure 1.2.1(b) observes these conventions. 

The next theorem is due to [Knuth]. 

Theorem 1.2.4 . For any network C that sorts with respect to a total order 
T, there exists a standard form network C that sorts with respect to T 
and contains the same number of comparators as C. 

When there is an implicit total order T on the domain D, it will be 
useful to extend the notion. of standard form sorting networks and 
the conventions for drawing them to comparator networks in general 
by omitting the arrowheads when xTy for every comparator <x,y> in the 
network . 

In what follows, the usual "higher is greater" convention for 
ordering diagrams of partial orders is inverted to conform to the 
conventions for drawing standard form networks. That is, xPy iff x is 
connected to y by a path going downwards in the ordering diagram for 
the partial order. P. This causes the top- to-bottom arrangement of 



n 
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domain elements to be the same for either the ordering diagram of a 
total order T or the wires of a standard form network that sorts with 
respect to T. 



Example 1.2.5 The standard form network 



a 
b 
c 
d 



is a sorting network with respect to the total order 



t a 

b 
c 

d 



□ 



1.3 The Analysis Problem for Sorting Networks 

It is often quite difficult to decide whether a comparator network 
sorts. For example, it is difficult to verify by inspection that the 
standard form network of Figure 1.3.1 is in fact a sorting network. 



Figure 1.3.1 Sorting network. 
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This difficulty is reflected in the fact that S(n), the minimum number 

of comparators in any sorting network on an n-element domain, is unknown 

2 
for n > 8; asymptotically, S(n) is known to be at worst ry(nlog n) , but 

might be as small as CT(nlogn) [Knuth]. Another manifestation of the 

same problem is that it is very difficult to design networks which are 

"good" in the sense that they contain as few comparators as possible; 

the only systematic design techniques known are based on recursive merges, 

2 
and give rise to nlog n growth rates in the number of comparators required 

[ VanVoorhis] . 

There are at least two possible avenues to a better understanding of 
sorting networks. First, it would be useful to have better criteria for 
determining whether a comparator network is or is not a sorting network. 
In particular, a criterion which would lead to an improved upper or lower 
bound on the number of comparators in a sorting network would of course 
be very desirable. Second, better techniques for analyzing comparator 
networks are needed, since a more complete understanding of the capa- 
bilities and limitations of comparator networks in general would lead 
to a better picture of what is going on within sorting networks. 

This thesis explores these two avenues. Chapter 2 discusses two 
criteria, one of them new, for deciding whether a comparator network 
is a sorting network. Chapter 3 develops two related ways of charac- 
terizing the "state of the sort" in terms of sets of assignments that 
can appear as comparator network outputs. Chapter 4 explores the notion 
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of sorting with respect to a partial order. Finally, Chapter 5 contains 
a discussion of the results of the previous chapters and recommendations 
for further research in the area. 
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CHAPTER 2 
CRITERIA FOR DECIDING WHETHER A NETWORK SORTS 



2.1 Comparator Networks as Finite State Machines 

This section discusses an implementation of the comparator operation 
as a finite state machine. In this section, the term "comparator" will 
refer to the finite state machine implementation rather than to the opera- 
tion itself, and the term "comparator network" will refer to the imple- 
mentation of a comparator network as a network of finite state machines. 
The term "assignment" will refer to an assignment with wires as the 
domain and sequences of binary digits as the range; each binary sequence 
implements the binary representation of an integer with the understanding 
that the most significant bit is first in the sequence. 

The state table for a comparator is shown in Figure 2.1.1. The 
starting state is E, and as long as the upper and lower input symbols x, 
and x 2 agree, the machine remains in state E. As soon as x 1 differs 
from x 2 , the machine enters state L or state G depending on which input 
digit is and which is 1. State L is entered if x.. is 0, indicating 

x, 1 1 
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Figure 2.1.1. Comparator state table. 



17 



that the integer represented on the upper input wire is less than the 
integer represented on the lower. In state L, z. = x and z = x„, 
thus leaving the assignment unchanged. State G is entered if x„ is 0, 
indicating that the integer represented on the lower input wire is the 
smaller of the two; in state G, Z;L = x £ and z 2 = x so that the outputs 
are the transposition of the inputs. If a new assignment is to be 
input to the comparator, the comparator must be reset to state E. 
Since a comparator network is a loop free interconnection of 
finite state machines, it is itself a finite state machine. A network 
containing k comparators has 3 states, some of which may be equiva- 
lent or unreachable from the starting state. It will be shown that 
a comparator network is a sorting network only if it contains a certain 
number of reachable states. 

Definition 2.1.1. Let C be a finite state machine, let f be any assign- 
ment, and suppose f takes the machine C from its starting state to 
state s. Then C f (g) will denote the output that results when the 
assignment g is applied to C, starting in state s. O 

The notation of Definition 2.1.1 is consistent with that of Definition 
1.2.2 under the convention that C(f) is just another way of writing 
C^(f), where \ denotes the input sequence of zero length. (Since \ 
leaves the machine C in its starting state, C^(f) is the output that 
results when f is applied to C in its starting state.) 
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Definition 2.1.2 For any finite state machine C, let = denote the binary 
relation on input sequences defined by 

f l = c f 2 * < V *> ( C f/ S) = Cf 2 (8>) 

The relation = is an equivalence relation called the Nerode equivalence 
c 

relation of C. It is a well-known result in automata theory that the 
blocks of the partition induced by ~ c on the set of all input sequences 
are in one to one correspondence with the reachable states of any reduced 
machine equivalent to G. 

The following theorem is a variation of Bouricius ' s theorem 
[Knuth]. 

Theorem 2.1.3 Let f and f be assignments on domain D and let C be 
any comparator network on D with C(f^) = fj and C(f 2 ) = f^- If 

(V x , y eD)(f 1 (x) £ f x (y) =» f 2 (x) < f 2 (y)) 
then 

(Vx, y€D)(f|(x) <: fj(y) =» f 2 (x) <■ f'(y)) 

That is, if f„ is an order -homomorph of f then C(f 2 ) is an order-homomorph 
of C{i x ). 

Proof : The proof is by induction on the number of comparators in C. 

Basis : If C has no comparators, f, = f ' and f^ = f' 2 so the statement 
of the theorem is obviously true. 
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Induction step : Let the statement of the theorem be true for all networks 
containing n or fewer comparators, and let C' be a network of n+1 compara- 
tors. C 1 can be viewed as the composition of a network C of n comparators 
and a single comparator <a,b>. Let f- and f be any two assignments on D 
with C(f.,) = fj and C(f„) = f' and suppose that 

(Vx, y^D)(f 1 (x) * f 1 (y) => f 2 (x) £ f 2 (y)). 

Since C has n comparators, the induction hypothesis guarantees that 

(V x , yQ))(fJ( X ) < f|(y) =» f 2 (x) ^ f 2 (y)). 

Letting <a,b>(fp = f^ and <a,b>(fp = f£, it is clear that fj = f" and 
f 2 = f 2 ' as long as fj(a) £ f]_(b). If f|(a) > fj(b), then fj(b) ^ f|(a) 
and f 2 (b) <: f 2 (a), so that f" = TT -1 .f| and f' 2 ' = TT~ ^f^ where tt is the 
permutation (ab). In any event, 

(Vx, y pD)(f^(x) ^ f£(y) =» f£(x) £ f 2 '(y)). □ 

Corollary 2.1.4 If f, and f are order-isomorphic assignments on D, i.e. 
if 

(Vx, yPDXf^x) * f ] _(y) « f 2 (x) <: f 2 ( y )) 

then for any comparator network C on D, f.. and f leave every comparator 
of C in the same state. 



n 
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Proof : For any comparator <a,b > in C, apply the theorem to the portion 
of the network to the left of <a,b>. The assignments f ' and f' 2 that 
appear at the input of < a,b> when C is applied to f_ and f , respectively, 
satisfy 

f '(a) ^ f '(b) « f'(a) ^ f£(b) 

It is easy to verify that 

f '(a) < fj(b) « f£(a) < f'(b) 

fj[(a) = f{(b) » f'(a) = f'(b) 

q(a) > f'(b) » f£(a) > f£(b) 

so that f.! and fi leave <a,b> in the same state. 

Definition 2.1.5 Let = denote the binary relation on A_ defined by 

f x = f 2 « (V X , y€D)(f 1 (x) ^ f x (y) <* f 2 (x) ^ f 2 (y)) 
That is, f- - f„ iff f- and f„ are order isomorphic. 

The binary relation - is an equivalence relation on A_ whose equivalence 
classes (order isomorphism classes) form a partition of A_. It will be 
useful to represent each block of the partition by a particular element 
of the block. 

Definition 2.1.6 For every assignment f on the domain D the assignment 
r is defined as follows: 

f\x) = !{f(z)!f( Z ) < f(x)}l 

That is, f(x) is the number of values f(z) in the range of f that are less 

than f(x). O 



□ 
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Example 2.1.7 If f is the assignment on D = {a,b,c,d} defined by f(a) = 3, 
f(b) = 4, and f(c) = f(d) = 1, then f is the assignment defined by f(a) = 
1(1} | = 1, f\b) = If 1,3} ! = 2, and f\c) = f\d) = !{]!= 0. H 



Theorem 2.1.8 For any assignment f in A_, f = f. 

Proof : Suppose f(x) ^ f(y). Then 

(f(z)lf(z) < f(x)} e (f(z)lf(z) < f(y)} 
so f(x) ^ f(y). Now suppose f(x) <■ f(y) is false, so that f(x) > f(y); then 

(f(z)lf(z) <f(y)} cr (f(z)lf(z) < f(x)} 
and f(x) > f(y), so f(x) ^ f\y) is false. D 



Theorem 2. 1.9 For any two assignments f 1 and f„ in A_, f. = f_ =* f = f„. 

Proof : Let ^ = f^ Then for all x, f^z) < f (x) iff f 2 (z) < f 2 (x) and 
f 1 (z) = f 1 (z') iff f 2 (z) = f 2 (z'), from which it follows that Iff^z) lf.(z) 
< f^x)} I = l{f 2 (z)lf 2 (z) < f 2 (x)} I and f^ = r^. n 

Theorems 2.1.8 and 2.1.9 imply that every block of the partition of 
A = induced by = contains exactly one assignment of the form f. It will 
now be argued that if C is a sorting network, = is the same equivalence 
relation as -. 
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Theorem 2. 1. 10 If C is a sorting network on an n-element domain D, 
then for all assignments f.. and f„ in A_, f, = f„ ** f- = f„. 

Proof : In view of Corollary 2.1.4, f, = f. => f, ~ f . If f = f , 
1 I lc2 1 c 2 

then since f, - f, and f„ = f„ f = f 1 and f_ = f_, i.e. f, = f„. 
1 1 I 2'lcl 2 c 2' lc2 

Since f- = f„ implies f, = f , it remains to show that f, - f_ implies 
1 2 r 12' 1 c 2 r 

A A 

f- = f~. It will be convenient to let the domain D be the set (0,1,2,... 

n-1] . 

Let f, 4 f 2 > so that f. (i) ^ f 2 (i) for some i. The set 

(minCf^i), r' 2 (i))!r > 1 (i) 4 ^(i)} 

is nonempty; let j be such that min(f..(j), f~(j)) is the least element of 
this set and f..(j) ^ f ? (j); without loss of generality, let f..(j) < f~(j). 
Let k denote the number of locations i in D such that f, (i) < f..(j), and 
define the function g as follows: 



g(i) 




Now 



consider CA (g) = h.. and CA (g) = h„. It will be argued that h- (k) = 
and h„(k) 4- 0. First, since there are k locations i with f (i) less than 
f\(j) 5 C(f ) = r ' is an assignment with f ' (k) = f - ( j ) because C is a 
sorting network. Evicently, h.. (k) is the smallest of the values g(i) such 
that f, (i) = f..(j); since g(j) is the smallest possible such value, h. (k) = 
g(j) = 0. 
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Now consider h„(k). h~(k) = only if there are exactly k locations 
i with fjCi) < f 2 (J)- But since f , (i) = f~(i) for every i such that 
f-. (i) < f-i(j) by definition of j, there are exactly k locations i such 
that f-CO < f-j(j). This implies that for no location i is it the case 

that f-(j) ^ f„(i) < f ? (j). In particular, there can be no location i 

A A A 

with f„(i) = f 2 (j) - l. Since f „ ( j ) is the number of elements in the set 

{f_(z)|f 2 (z) < f 2 (j)}, this is a contradiction. Therefore h„ (k) 4- and 



h x 4- h 2 , implying f^ 



f„ is false, 
c I 



U 



Example 2.1. 11 This example illustrates the proof of Theorem 2.1.10. The 
assignments f-, f„, C(f.) = f ' C(f„) = f ' g, h , and h„ are given in the 
table below. 
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First, notice that the smallest element of {min(f.(i), f „ (i)) I f .. (i) 4- 
f (i)} is 1; since f_ (5) = 1 and f„(5) = 3, set j = 5. (The function g 
given in the table was chosen for this location j , although j = would 
have worked equally well.) Since f- (i) < f..(5) for i = 1,4, and 7, 
set k = 3. Notice that h.. (3) = because g (5) = 0, but because f„(i) < 
f„(5) for 7 locations i and 7 is greater than 3, h„(3) 4 0; in fact, 
h 2 (7) = 0. 

Corollary 2.1.12 No two reachable states in a sorting network C are 
equivalent. 



Proof : Suppose f, and f leave C in equivalent states, so that 

f. = f„; by Theorem 2.1.10, f - f • finally by Corollary 2.1.4, f, and 

f„ leave C in the same state. 

Corollary 2. 1. 13 A sorting network C on an n-element domain has 



n 
cr(n) = 7 k! {£} 
k=0 

reachable states, where { } denotes a Stirling number of the second kind. 



Proof : It suffices to count the number of distinct functions of the form 
f for a domain of n elements. In fact, the number of functions f is 
equal to the number of totally ordered partitions on an n element domain D. 
To see this, let £ be such a partition, totally ordered by T, and for 
any element x€D let f(x) be the number of blocks of ?■ that are T-less than 
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the block containing x. It is not hard to verify that there is precisely 
one ordered partition corresponding to a given f and vice versa. Since 
{,} is the number of unordered partitions of an n element set containing 
k blocks, and since there are k! ways of ordering every such partition, 

CT(ti) is the number of totally ordered partitions on an n element domain 

A 
and hence the number of functions of the form f. H 



It can also be shown that any comparator network that has c(n) 
reachable states has the property that the reachable submachine of 
the network is isomorphic to the reachable submachine of a sorting 
network with respect to state transitions. 

2.2 The Zero-one Principle 

Where as it might be thought that some comparator network could 
successfully sort all zero-one valued assignments and yet fail to 
sort a more "complex" assignment, this cannot in fact occur; Theorem 
2.2.1 shows that a test to see if all zero-one valued assignments are 
sorted by the network is conclusive. A proof may be found in [Khuth]. 

Theorem 2.2.1 (zero-one principle) A comparator network sorts every 
assignment in A_ if it sorts every assignment in Z_. D 

The zero one principle is very upeful for deciding whether or not 
a comparator network sorts. 
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It is the purpose of this section to explore the question "for 
which subsets of Z d ° there exist comparator networks that sort 

precisely the assignments in those subsets". For example, it is 

possible for a comparator network to sort every zero-one valued 

assignment but one? the answer is yes. To prove this, a lemma 

will be needed. The proof is straightforward. 



Lemma 2.2.2 The network N depicted below sorts every element of Z_ 



except the assignment 




1 
0' 
1 



and N 





1 

1 



□ 



Now for the theorem itself. 

Theorem 2.2.3 If g is any assignment in Z_ except the constant zero 
or constant one functions, there exists a comparator network which 
sorts every element of Z_ except g with respect to some total order T. 



Proof : Let the domain D be the set { 0,1,2,. . .n-1) , and let g be 
an assignment on D of the form 
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Co 



locations ^ 
(0 to m-1) 



n-m-2 
locations 
(m+2 to n-1) 





10 
1 


i • 

u 



where ^ m ^ n-2. Now let g be applied to the standard form network C shown 
below. The boxes marked "SORT" are sorting networks, and the boxes marked 
"N" are networks of the kind shown in Lemma 2.2.2. 
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SORT 
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SORT 
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s) 











m-3 

m-2 

m-1 

m 

m+1 

m+2 

m+3 

m+4 

n-1 



It is easy to verify that C(g) = g is not sorted with respect to ^. 
Now let h ^ g be any other assignment in Z_. If h is applied to C, then 



at least one of the following four things must be true: 
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1. There is at least one 1 on input wires through m-1; 

2. There is a on input wire m; 

3. There is a 1 on input wire m+1; 

4. There is at least one on input wires m+2 through n-1. 



In any event, the leftmost pair of sorting networks in C transform h into 

an assignment such that the leftmost N network in C does not receive the 


pattern _ at its inputs. It follows from Lemma 2.2.2 that whatever 

1 
this assignment may be, it is transformed by the leftmost N network 

into an assignment which is sorted on the wires m-1, m, m+1, and m+2; 

in particular, it cannot be the case that wires m and m+1 are assigned 

1 and 0, respectively, at the output of the leftmost N network. This 


means chat ft cannot appear at the inputs of the next N network in C, 

1 
or, inductively, at the input of any subsequent N network in C. In 

fact, every N network in C could be replaced by a four input standard 

form sorting network with no effect on the ultimate network output 

C(h). After this has been done, it is not hard to see that C(h) is 

sorted with respect to <; just verify that each iteration of the form 





SORT 
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decreases the distance between the uppermost one and the lowermost zero 
by at least one in propagating the assignment, and use the fact that 
there are n such iterations in C. For the degenerate cases m = and 
m = n-2, it will be necessary to remove the top (respectively bottom) 
wire from every N network together with all comparators touching that wire. 

Now let g' be an arbitrary nonconstant assignment in Z_, and let n 
be a permutation on D such that g = tt. g' is an assignment of the form 



m 
locations 



n-m-2 
locations 





6 

10 
1 

1 
1 
1 

U 



If C denotes the network that sorts every member of Z_ except g, let C' 

denote the network obtained by replacing every comparator <x,y> in C 

by the comparator <5T(x) , Tr(y)>. Since g(x) £ g(y) iff g'(TT(x)) ^ g'C^Cy)), 

C' sorts every assignment in Z_ with respect to the total order T that 

satisfies 

(?X, y(=D) (TT(x)TTT(y) « x < y) 
i.e. the total order defined by 

(Vu, vfD)(uTv » tt _1 ( u ) ^ TT _1 (v)) 
but fails to sort the assignment g 1 . I_ ] 
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An example will be useful to clarify the construction of Theorem 
2.2.3. 

Example 2.2.4 . It is desired to construct a network which sorts every 
assignment but the assignment g' on D = {0,1,2,3,4} defined by 



;'(x) = 



if x = 3 



1 otherwise 



Now the network C shown below 



LA 



t t 



i-JL 



±_i 



;orts every assignment but g, where g is defined by 



g(x) = 



if x = 1 



1 otherwise 




1 
2 
3 
4 



(Notice that since there is only one wire for which g(x) - 0, the top 
wire of the network N has been removed together with all comparators 
touching that wire.) 

Since T\ = (13) is a permutation such that g = TT-g', the network C 
shown below 
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sorts every element of Z_ except g' with respect to 



Corollary 2.2.5 In verifying that an n-input comparator network sorts 
by means of the zero-one principle, it is necessary to try 2 -2 inputs, 
namely all the nonconstant zero-one valued assignments. P 

Theorem 2.2.3 could be modifed to deal with standard form networks, 
which of course must sort at least those zero-one valued assignments 
that are already sorted. 

Among other things, Theorem 2.2.3 indicates that all nontrivial 
statements of the form "any comparator network that sorts every element 
of this set of zero-one valued assignments also sorts that zero-one 
valued assignment" are false. The next theorem, analogously, denies 
the possibility of similar statements about assignments not sorted. 
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Theorem 2.2.6 For any zero-one valued assignment g, there exists 
a total order T and a comparator network C which sorts only that 
assignment (and the two constant assignments) with respect to T. 

Proof : Let g be an assignment on D = f 0,1,2,. . .n-1} of the form 



m 
locations 



n-m 
locations 



where < m ^ n. Now let g be applied to the network C shown below. 
The boxes marked "REV SORT" are sorting networks which sort in reverse, 
i.e. with respect to the total order ^. 



g=0 



g-1 





REV 
SORT 
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REV 
SORT 














* 





1 

2 

m-1 
m 

m+1 
m+2 

n-1 



Clearly C(g) = g is sorted with respect to ^, as are the constant zero 
and constant one assignments, but no other assignment in Z_ is sorted 
with respect to ^ . Now let g' be any assignment in Z_, and let tt be a 
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permutation on D such that g = TT.g" is an assignment of the form 



m 
locations] '. 



\l 




A transformation of the comparators in G analogous to that performed in 
Theorem 2.2.3 establishes the theorem. P 

There are certainly some sets of zero-one valued assignments for 
which there can be no comparator network sorting exactly the members 
of that set. 

Example 2.2.5 No comparator network containing one or more comparators 
can sort each of the assignments. 

1 



• • 



• ■ 



... 1 
1 1 
0, 1, 1 1 



without sorting some other assignment. 
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Proof: The leftmost comparator in the network will receive a zero at 

one input and a one at the other for some assignment in the list. 

The assignment which results in the opposite arrangement of the zero 

and the one at the leftmost comparator input must also be sorted, but 

it is not in the list because interchanging a zero and a one in any 

assignment in the list will result in an assignment not in the list. CD 
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CHAPTER 3 
COMPARATOR NETWORK OUTPUT BEHAVIOR 



3.1 Output Characterizations 

The set of assignments that can appear at the output of a comparator 
network is sufficient to determine which networks can be concatenated to 
the network to make the combination a sorting network. Thus it is often 
useful to know the assignments that can appear at the output of a given 
comparator network. To the extent that sets of output assignments can be 
represented succinctly and manipulated easily, the problems of designing 
and analyzing sorting networks will become easier. In this chapter, two 
different kinds of assignments will be considered: injective assignments 
and zero-one valued assignments. These two kinds of assignments are related 
by the notion of threshold. 

Definit ion 3. 1.1 If f is any assignment from D to R then 6(f), the set 
of thresholds of f, is defined by 

9(f) = [g:D -» {0,1} | (3r £ R) (Vx € D) 

(g(x) =1 Iff r £ f(x)} 

If A is any set of assignments from D to R, then 

9(A) = U 9(f) 
f€A 

is the set of thresholds of A. H 
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Example 3.1.2 The set of thresholds of the assignment f: {a,b,c,d} -► 
{0,1,2,3} defined by f(a) = 0, f(b) = f(c) = 1, f(d) = 2 is the set 
(g > 8j_> g 2 » 83), where the functions g. are given in the table below. 



X 


f(x) 


g (x) 


g x (x) 


a 





1 





b 


1 


1 


1 


c 


1 


1 


1 


d 


2 


1 


1 



g 2 (x) 


g 3 (x) 




















1 






H 



Notice that an assignment f is sorted iff all of its thresholds are sorted. 
The following theorem is a close relative of the zero-one principle. 

Theorem 3.1.3 For any network C and any assignment f, C(9(f)) = 9(c(f)). 

Proof: Let g' € C(9(f)), so that g' = C(g) for some g € 9(f). Since 
f(x) ^ f(y) => g( x ) £ g(y) for all x and y, Theorem 2.1.3 guarantees that 
f'(x) < f'(y) =* g'(x) < g'(y). If g'(x) = for all x, certainly g' £ 9(f); 
otherwise, set 

r* = min {f(x)lg , (x) = 1} 
xQD 

and let z be any element of D for which f'(z) = r', hence for which g'(z) = 1. 

Now for all x, if r' <: f'(x), i.e. if f'(z) £ f'(x), then 1 = g'(z) £ g'(x) 

and g'(x) = 1. Conversely, if g'(x) = 1, then r* £ f'( x ) by definition of r'. 

It follows that g' € 9(f), and so C(9(f)) c 9(C(f)). Now, every element g 

in 9(f) is characterized uniquely by the number of elements in D mapped to 

zero by g. Since C merely permutes the domain of each g € 9(f), !c(9(f))l = 

'9(f) I; since C applied to f just permutes the domain of f, 1 6(C(f) ) I = 
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!9(f)l. Hence C(9(f)) = 9(C(f)). 

The following corollary illustrates the use of Theorem 3.1.3. 

Corollary 3.1.4 For any two networks C and C', the following statements 
are equivalent: 

1. C' sorts every assignment in C(Z_), the set of zero-one valued assign- 
ments that can appear at the output of C. 

2. C concatenated with C' is a sorting network. 

3. C' sorts every assignment in C(I = ), the set of injective assignments 
that can appear at the output of C. 

Proof : 1 implies 2 because of the zero-one principle, and 2 implies 3 by 
virtue of the definition of a sorting network. It remains to show that 
3 implies 1. Let g 1 be any zero-one valued assignment that can appear 
at the output of C. Then g' = C(g) for some g. Now, g € 9(f) for some 
injective assignment f; letting C(f) = f, g' € 6'(f) by Theorem 3.1.3. 
Since C' sorts every injective assignment in C(I = ), C'(f') is sorted 
and so is every element of 9(C'(f')). Since 9(C'(f')) = C'(9(f')), every 
element of 9(f) (including g') is sorted by C ' . 

Corollary 3.1.4 guarantees that either the zero-one valued output 
assignments C(Z_) or the injective c-Lpat assignments C(I_) adequately 
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characterize a network C for pur poses of designing a network C' so that 
C concatenated with C is a sorting network. On the other hand, if the 
network C' is given and it is desired to design a network C so that C 
concatenated with C' is a sorting network, then the network C' is 
characterized for this purpose by those assignments that it sorts. 
In the light of Theorem 3.1.3, it is not surprising that the zero-one 
valued assignments sorted by C' characterize the infective assignments 
sorted by C ' . 

Theorem 3.1.5 If I is the set of injective assignments sorted by the 
network C then for every injective f, 6(f) £ 9(1) =» f € I. 

Proof : Let 6(f) £ 6(1) with f I. Then f = C'(f) is not sorted, 
so there is a zero-one valued assignment g' f 9(f) which is not sorted. 
Since g' € 9(C'(f)), g f € C'(9(f)) and so g' = C'(g) for some g € 9(f). 
Since 9(f) C 9(1), there exists an injective h in I with g £ 9(h). Since 
h £ I, C'(h) is sorted and therefore every element of 8(C'(h)) is sorted. 
This implies g' € C'(9(h)) is sorted, a contradiction. D 

The example below shows that C' may in fact have to sort more injective 
assignments than those in C(I_) if C concatenated with C' is to be a 
sorting network. 

Example 3.1.6 The network 
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transforms the set I = of injective assignments with range [1,2,3,41 
into the set 

1 2 1 "") 
C(I ) 




and transforms Z into the set 



11 

C(Z_) = ,0000101 
1 1 1 1 1 
0, 1, 0, 1, 1, 1, 1 

Since e I , I - C(Z_) and since any comparator network C' that sorts 

every element of C(I_) must also sort every element of C(Z_), such a 

2 

network C' sorts 

4 



This example suggests that zero-one valued assignments may be more 
useful than injective assignments for output representation. This 
hypothesis will be reinforced by the results of section 3.4; the next 
two sections will be devoted to a more detailed examination of the 
properties of these two kinds of output assignments. 

3.2 Zero-one valued output assignment. 

Any set Z of zero-one valued assignments can be described by its 
characteristic function, which in turn can be described by a Boolean 
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expression. For convenience, let the domain of the assignments be 
D = (0,1, . ..n-11 . 

Definition 3.2.1 If Z ^ Z = is a set of zero-one valued assignments on 
domain D = f 0, 1, . . . n-1 1 , then the characteristic function of Z is the 
function k from Z_ to (0,1] defined by 



k(g) 




Since there are 2 assignments g in Z_, each of which is a function 
from D to (0,1], it is possible to represent a characteristic function k 
by a Karnaugh map or a Boolean expression in the n variables x n , x- , ... 



<. _ 1 . For example, the ne 



twork 




1 



- 2 

— 3 



has the set of output assignments C(Z_) described by the table below. 



X 
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1 








1 
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1 
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1 





1 
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1 


1 



The Karnaugh map for the characteristic function of C(Z_) is 
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x 2 x 3 



X X 1 



00 
01 

11 

10 



00 01 11 10 



1 


1 


1 





1 


1 


1 


1 








1 


















and this function can be described by the expression x'x. + x'x 1 + x 'x 
+ x^x^x^. In this fashion, a Boolean expression can describe any set of 
zero-one valued assignments, and in particular, the set of zero-one 
valued outputs G(Z_) of a comparator network C. 

A comparator < i,j> concatenated to the output of a network C results 
in a new network C' = C» < i,j > , a new set of zero-one valued output assign- 
ments C'(Z_) and hence a new characteristic function described by a new 
expression. The following definition will be useful in describing this 
phenomenon. 



Definition 3.2.2 If E is a Boolean expression in the variables x n ,x...... 

x , , then E/ , . is the expression obtained by replacing every 
n— i. \a . . x . / 

l' j 

occurence of x. in E byx. and every occurence of x in E by x.. 

The theorem below describes the effect of a comparator <i,j> 

on a set Z of zero-one valued assignments. This is done by giving an 

A 
expression E for the characteristic function of <i,j> (Z) in terms of i,j, 

and any expression E for the characteristic function of Z. 



□ 
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Theorem 3.2.3 If Z is a set of zero-one valued assignments on the 
domain D = { 0,1, . . .n-l 1 and E is a Boolean expression for the charac- 
teristic function of Z in the variables x^.x, ,...,x ,, then the 

0' 1' n-1 

comparator <i,j > transforms Z into a set whose characteristic function 

A 
is described by the expression E, where 

A 

E = Ex' + E/, . x. 
i (x i5 x ) j 



Proof : Every assignment g € Z can be classified as to whether g(i) = 
or g(i) = 1. Let Z n and Z partition Z according to g(i): 

z Q = [ g f z! g (i) = 0} 

Z x = fg € z|g(i) = 11 

and let E„ be the expression Ex! and E, the expression Ex.. E~ is an 
x 1 x 

expression for the characteristic function of Z„ because g € Z„ iff 
g (z Z and g(i) = 0; similarly, E.. is an expression for the characteristic 
function of Z 1 . Since Z = Z~ U Z , the expression E„ + E 1 is an expression 
for the characteristic function of Z; moreover, the effect of the compara- 
tor <i,j > on Z can be determined by its effects on Z„ and Z . In parti- 
cular, the comparator has no effect on Z„, since g(i) = for every 
g f Z n , but the comparator interchanges the values of g(i) and g(j) for 
every g € Z.. since g(i) = 1 for these g. It follows that 

^O+VCX^X.) - H +(E *I )/ 0C 1 ,K J ) 

or 

A 

E = Ex'. + E/ , .x . 

i (x^x,) J 
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is an expression for the characteristic function of the set <i,j> (Z). H 

Since convenient representations for sets of zero-one valued assignments 
are desirable, let us explore representations for Boolean expressions. 
The product of sums form for expressions seems to be most useful because 
it provides a convenient way of representing the kinds of statements 
used to describe consistency. First, a theorem about the form of any 
product of sums expression for a set of output assignments. 

Theorem 3.2.4 If C is any comparator network and E is any product of 
sums expression for the characteristic function of C(Z = ), then every 
factor in E must contain at least one complemented variable and at 
least one uncomplemented variable. 

Proof: It is clear that C(Z = ) must contain both the constant zero 
assignment (the assignment that is zero for every location in D) and 
the constant one assignment. Now suppose some factor in E contains 
no complemented variable. Then the constant zero assignment could 
not appear in C(Z = ), a contradiction. Similarly, every factor in 
E must contain an uncomplemented variable if the constant one assign- 
ment is to appear in C(Z_). H 

Corolla ry 3.2.5 The set of zero-one valued output assignments C(Z ) 
for any comparator network C has a characteristic function which can 
be described by an expression of the form 
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- TT r (TTO-(^ -A 

k=l 16^ j€B k 



Proof : Write the k th factor in a product of sums form for E as x± + 
X x. ; theorem 3.2.4 guarantees that the sets ^ and B k are nonempty. 
The result then follows from DeMorgan' s law. 

When the set C(Z = ) of zero-one valued output assignments consists 
precisely of those assignments consistent with a certain partial order 
P, then a particularly simple form for E is possible, based on the 
covering relation for P. 

Definition 3.2.6 If P is a partial order on D, then the covering 
relation for P is the relation P on D defined by 

iPj » iPj A i^j A (Vk) 

((iPk A kPj) =» (k=i V k=j)) 

The covering relation P for a partial order P is irreflexive, 
antisymmetric, and intransitive, and any irreflexive, antisymmetric, 
and intransitive relation P is the covering relation for some partial 
order P (namely the reflexive transitive closure of P). 



P 
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Theorem 3.2.7 Let C be a comparator network. The characteristic function 
for C(Z_) has an expression of the form 



E- = (x .' + x . ) 

P _ L J 

(i,j)fP 

where P is irreflexive, antisymmetric, and intransitive, if and only if 
C(Z_) -Z for some partial order P with P the covering relation for P. 

Proof : It will be shown that for any partial order P, E- is an expression 

for the characteristic function of Z ; since every partial order has a 

unique covering relation and every irreflexive, antisymmetric, intransitive 

relation is the covering relation for some partial order, this will 

prove the theorem. So let P be a partial order on D, with P the covering 

relation for P, and suppose g f Z . Then iPj => g(i) < g(j), and since 

P C P, iPj => g(i) ^ g(j). This means that g(i) = or g(j) = 1 for all 

ordered pairs (i,j) f P, so that the expression E- evaluates to 1 (the 

characteristic function evaluates to 1) for g. Now suppose E- evaluates 

to 1 for some g c Z = , so that g(i) = or g(j) = 1 for all (i,j) € P. 

This means that iPj =» g(i) < g(j). Now let iPj . Since P is the reflexive 

transitive closure of P, either i=j , and g(i) < g(j), or there exists a 

chain i = a Q ,a 1 ,a 2 , . . . a^ = j in P with Sq^, a-jPa^ . . . a^Pa^.. In the 

latter case it follows that g(a Q ) ^ gCa^^) < g(a 2 ) < ... < g(a r > , so 

that g(i) < g(j). Having shown that iPj =* g(i) ^ g(j), we conclude 

that g f Z . r 
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Theorem 3.2.8 provides a generalization of Theorem 3.2.7. 

Theorem 3. 2.8 Let C be a comparator network on D, and let R C DXD be 
a binary relation such that 

(x. 1 + x.) 



E R = 



i J 



is an expression for the characteristic function of C(Z = ). Then there 
exists an irreflexive, antisymmetric, and intransitive relation R e R 
such that 

E- = I l„ <*i + *<> 
R (i,j)?R J 

is also an expression for the characteristic function of C(Z = ). 

Proof : it will be shown that R is antisymmetric. Given this fact, it 
will be possible to show that R, the "irreflexive intransitive part" of 
R, satisfies the conditions of the theorem. To show that R must be 
antisymmetric, assume (x^ + x.) and <. x j + x ± ) both occur in E R , and 
consider an injective assignment f in C(I = ). Because of the symmetry 
between x and x. no generality is lost by letting f(i) < f(j); this 
implies the existence of a zero-one valued assignment g 6 9(f) with 
g(i) = and g(j) = 1. Since g f 6(f), g € C(Z = ) by Theorem 3.1.3. 
But E evaluates to for g because x ' + x evaluates to 0, a contra- 
diction. 
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Now let R be defined by 

R = {(i,j)9l! i^j A 

(Vk)((iRk A kRj) =» (k=i V k=j))} 

R is irreflexive and intransitive by construction, and antisymmetric 

because R is antisymmetric. The only factors in E that are not in 

R 

E - 
R are either of the form (X ! + x.), which is equivalent to 1, or of 

the form (x ] + x .), with factors of the form (x. ' + x ), (x' +x ) ... 
J l 3;L a;L a 2 

(x ' + x.) all appearing in E- (and E_). In either case, it is easy 
a j R R ' J 

r 

to see that omission of these factors from E does not change the 

R 

characteristic function described by E , so E- and E n describe the same 

R R R 

characteristic function. P 



There exist algorithms ([Miller] ppl50-175, for example) which 
reduce an expression E to minimal product of sums (or sum of products) 
form. Here "minimal" means that any other equivalent expression contains 
at least as many literals as does the minimal one. Such a minimum 
expression affords a fairly compact representation for the zero-one 
valued outputs of a comparator network, especially when the conditions 
of Theorem 3.2.7 are satisfied. 

It is possible to replace any product of sums expression of the 
form given in Corollary 3.2.5 by an equivalent expression in a form 
which will be useful in Section 3.4. 
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Theorem 3,2.9 An expression of the form 



m 



B-TT r (n\) , + (£ -,)]. 

k=l i<\ j€B k 

with A, and B, subsets of D, describes the same characteristic functions 
as the expression E given by 

* - ^ TT (x- + x ) 

R^ft (p,q)^R P q 

where (R is the family of binary relations on D such that R€Qv,iff 

r C ( U A ) X ( U B ) and R (A, X B ) is a singleton for k = l,2,...m. 
k=l * k=l k k k 

Proof : Rewrite each factor of the form 

("n\y + (I ^ - (I 4) ♦ (£ ., 

*% J^k 3 le v J^k 3 

in the product, duplicating terms as necessary to obtain a factor of the 
form 

V 

(xl + x.) 
(i,j)€A k XB k x J 

Then multiply all the resulting factors to yield 

L II (x' + x ) 

p q 

R€& (p,q)€R 

where (R is the family of binary relations described in the statement of 
the theorem. -- 
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Example 3. 2. 10 The expression 



E - (xq +x| +x 2 ) (x2 + x- l + x 3 ) (x^ +x^ +x 4^ 



is of the form 



I x, ' + ' 



\ "1 



k=l i€. 



\ 



V 



J^B 



k 



with Aj_ = {0,1}, ^ = {2}, ^ = (3;, 1^ = { 21 , B 2 = {1,3], and B 3 = '1,4 
Rewriting the factors of E gives 

[(x'4«_) + (x'+x„)i [(x;4 Xl ) + cx:+x,)] uxi+o + (x:4x.)] 



w 2 



12 



2 1 



2 3' 



3 1' 



3 4- 



Multiplying out, we get 

(x^+x 2 ) (x 2 +x 1 ) (x^+x 1 )+. . .+(x^+x 2 ) (x 2 +x 3 ) (x^+x 4 ) 
which is an expression of the form 



A 
E 



R^ & (p,q)€R 



x' + X ) 

p q 



where $_ is the family of relations 



{ {(0,2), (2,1), (3,1)}, {(0,2), (2,1), (3,4)1, 

f (0,2), (2,3), (3,1)', {(0,2), (2,3), (3,4)}, 

{(1,2), (2,1), (3,l)i, {(1,2), (2,1), (3,4)), 

{(1,2), (2,3), (3,1)1, ((1,2), (2,3), (3,4)1 } 
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By a construction similar to that used in Theorem 3.2.8, the 
binary relations R in (^ can be replaced by irreflexive and intransi- 
tive relations R; this is because the "reflexive and transitive parts" 
of R are redundant. Such a replacement will result in a reduction in 
the size of the expression E. It is not obvious that each R in ^ 
is antisymmetric, however; Theorem 3.2.8 does not apply because 
the expressions E R do not individually describe the entire set of 
output assignments. Moreover, a considerably smaller family of 
relations could be constructed than that arising from the procedure 
used in the proof; for example the proof procedure would rewrite 
(x'+x^+x +x, ) as the redundant expression 

(x'+x 3 ) + (x[-hc 4 ) + (x^+x 3 ) + (x^+x 4 ) 

rather than the more compact expression 

(xj+x 3 ) + (x^,+x 4 ) 

These two peculiarities of the theorem are related; Theorem 3.4.17 
will demonstrate that the redundancy in the family (^ will allow (Si 
to be reduced to a family of covering relations; the members of & 
whose reflexive transitive closure is not antisymmetric can be dis- 
carded. It will follow from this and other considerations in Section 
3.4 that the set of zero-one valued assignments at the output of any 
comparator network can be characterized by a family of partial orders. 
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3.3 Injective output assignments 

In contrast to the zero-one valued case, it is easily shown that 
C(I_),the set of injective assignments that can appear at the output 
of a comparator network, can be characterized by a set of partial 
orders. 

Theorem 3.3.1 For any comparator network C, 

c(i_) = U i 
pop p 

where IP is a (finite) family of partial orders P. 

Proof : Let P = {p|(P is a total order on D) A (3f £ C(I = )) (f€l p )} 
Since D is a finite set, P is finite as well, and certainly 

C(I_) C U I_ 
PfP P 

Now let f ' be an element of I for some P € P, so that for all x and 

y in D, xPy =* f'(x) ^ f'(y). Now P is in P by virtue of the existence 

of an assignment f in C(I_) such that xPy => f(x) ^ f(y). Since f is 

injective and P is total, f (x) £ f (y) => xPy, so that f (x) < f (y) =» 

f'(x) ^ f'(y). Finally, to show f € C(I = ), let tt be a permutation on 

D such that C(TT.f) = f; it is easily verified that C(tt- f) = f using 

Theorem 2.1.4. n 

Theorem 3.3.3 will show that it is in general unnecessary to require 
that every member of P be total. It will be useful to prove the following 
important theorem first. 
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Theorem 3.3.2 If P and P„ are partial orders, then P. £ P„ 



h CT P 
2 r l 



Proof: 



(=>) if P- s P 2 , then xP .y =» xP„y for all x, y f D. By 



definition of I , if f € I then xP„y =* f(x) ^ f(y) and therefore 
P 2 P 2 2 

xP x y =* f(x) ^ f(y), i.e. f € I . (4=) Let P ;L ? P 2> so that there 

exist elements a and b in D with aP..b and — i(aP~b). Let T be a total 

order containing P_ such that bTa, i.e. any total order containing the 

partial order obtained by taking the transitive closure of the set 

P U { (b,a)}. If f € I then xP„y =» xTy =» f(x) < f(y) and f € I , 
^ l ^ p 2 

but since bTa, f(b) ^ f(a) and f f I because f is infective. '""' 

P l 



Theorem 3.3.3 If I is a set of injective assignments satisfying 

i = U 1 



p€P 



P 



for a family of partial orders P and if P 1 = H P then 1=1, iff 

P 

every total order contain P' also contains some P £ P. 



Proof: (=*) If I = I , and P' s T for some total order T, then 
I e I pI by Theorem 3.3.2 and hence I - I. If f is any element 
of I , f £ I implies f 6 I for some P, and for all x and y, xPy ^ 
f(x) ^ f(y). Since f is injective and T is total, f(x) ^ f(y) =» 
xTy, so P £ T. 

(4=) Certainly I G I , since P' - P for every P f P . If f € I 
then let T be the total order defined by f, i.e. the total order 
with f € I it is easy to show that P' c T. But by hypothesis, 
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P £ T for some P f P. This implies that f ?L £ I =1 and since f was 

T p 

arbitrary, I ■ = I. □ 



Theorem 3.3.3 states that some subsets of the family IP of total orders 
discussed in Theorem 3.3.1 may be describable by intersections over 
those subsets, thereby giving a smaller family of partial orders. 

It remains to consider the effect of a comparator on a set I of 
injective assignments. 

Theorem 3.3.4 For any partial order P the comparator <±,2 > transforms 
I into the set 

T P - X P U Z P 
1 2 

where P.. is the smallest partial order containing P and (i,j), P„ is 
the smallest partial order containing rr .P.tt and (i,j), and tt is 
the permutation (ij). 



Proof : Let D = { 0,1, . . . ,n-l} and let I = L U G , with 

L p = {f € I p | f(i) ^ f(j)} 
G p = {f € I p | f(i) * f(j)} 

If jPi, then L p is empty; otherwise let P. be the smallest partial order 

containing P and (i,j). Certainly P £ P so that I £ I . Since iP.j, 

every f in I satisfies f(i) £ f(j), so I £ L . Now if f € Lp then 

1 1 P ■ 



>:here exists a total order I with f <~ : I PT ,, P ^ T, and iTj. Since P is the 

smallest partial order satis fving P T- P n and iPi , P, £ T and f r I £ T 

1 '1 T P 

Therefore L = I , The comparator <i,j> has no effect on any element 

1 

ni - hp, so that the image of L^ under the comparator is L = I . 

i P P l 

If iPj then G is empty; otherwise, let P be the smallest order 

containing ^ '• p,~ and (i,j). Certainly P ? £ -" . P.tt, so that I - 

T -"1 r i 2 

i _ ■] • Now . ^ = f- • 'T. £ - G ■ is precisely the same set as 

f c I _-, |f f >.) •- f (j) ■ because 

■p" -.p.-r 



-1 



G p « (xPy - ' : :; 'xVi < fnuy))) 

A ((-(i)) > f : (~(j)) 
" C ( ^)i r " (y) => f(x) < f(y)) 



Since every element o! [ satisfies f(i) ?' r ^' - ; ) . T. ^ " T " .G . Select 

P. -I Pr, P 

an f<-~ L -G n , and let T be the total order with f c [ . Now "~ -P.-' - T 
P' T 'T 

and iTj; since P,, is the smallest coral order satisfying these conditions, 

— 1 

P 7 ^ T and f ?- T '-" I . Therefore ~ ^.G - I . The comparator <i. , j> 



1 F„ " P "P. 

]. 



transforms every element f in G^ into "^ "«f, so that the image of G 



under <r i,j > is T, N . 

Putting the two images together, the comparator transforms I to 

T p if ip J > l p i 1 " j Pi , and I L i n if neither is true. 
1 2 K l r 2 



ie comparator <i „■•■-• •.-:■ forms the set of infective 



assignments 



into the set 
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A 
I 



U X P 



u U i p 

P 2 €P 2 P 2 



where P. = { P ! (3P € P) (P is the smallest partial order containing P 
and (i,j))}, P„ = {P '(^P ^ 5D )(P ? is the smallest partial order con- 
taining tt 'p.TT and (i,j))l, and tt is the permutation (ij). 



D 



An example is in order. 



Example 3.3.6 Consider the comparator network <1,2> • <3,4> • "^l^^" • 

<2,4> ' <2,3>. The family of partial orders P with C(I_) = I J I 

P<=P * 

is given below for each stage in the network. For each comparator 

in the network and for each P € P. , the partial orders P. and P_ 

are given, and the next family P. ., is of course the set consisting 

i+1 

of all P 1 and P arising from partial orders P in the preceding family 

P.. 



P r 1 2 3 4 i 



<L,2> : 



P l = 



p 

* • • • 

12 3 4 


P l 
IT . . 
2 1 3 4 


P ? 
J 34 



{ l \ 3 4} 



<3,4> 
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(1 I 3 

2 h 4 



r 



<L,3> 




:ri: 



P. 



T? rt: 



<2.4> 



* ? 



n: 


m 4 


i 
1 


1 
• 3 

■ 2 
"4 


;rt 


# 1 

*4 


3 fT 



P. 



A 



2 < 3 



,: 9 

H 



<2.3> 



p 





p 




P. 


P 






i 


? 




T 


* 1 


t 1 




i. 




- 2 


2 




2 < 3> 


1 


■ 3 
,4 


Ij 




4 












T - 1 




none 


! 3 




H 




u 
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Notice that there is no partial order V l arising from the partial 

1 1 

' 3 
order 2 and the comparator <2,3>, and that 

' 4 

U I, 



pep„ 



cannot be expressed as I pl for any partial order P'. Also, the total 

tl 
, -3 
orders 2 occurring after comparator <2,4> could have been eliminated 

■ 4 
via the criterion of Theorem 3.3.3 or merely by observing that 




t 1 

-'3 

2 

4 



1 
3 
2 
4 




n 



In section 3.4, the notion of a lattice of partial orders on a set 
will be introduced. This notion will help elucidate the connection 
between zero-one valued assignments and injective assignments. 



3.4 The lattice of partial orders 

In sections 3.2 and 3.3, two techniques for characterizing network 
outputs were developed which have many similar features. In both cases, 
for example, the effect of a comparator on the output set is reflected 
in the characterization by the formation of a union, and when certain 
conditions are met the characterization can be reduced to a single 
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partial order. The lattice of partial orders on a domain is a convenient 
vehicle for exploring this similarity further. 

Definiton 3.4.1 Let denote the set of all partial orders on the set D 

2 
together with the relation dXd = D . D 

The proof of the next theorem is straightforward. 

Theorem 3.4.2 The set ordered by £, forms a lattice with respect to 
the operations of set intersection and supremum, where the supremum 
operation V is defined in the usual way: 



P x V p 2 = n { P € D | P = P A P 2 <: P } 

Figure 3.4.1 depicts the lattice °r 1 2 }' ' rhe lattice is not 
modular, and therefore not distributive, for domains of more than two 
elements. However is useful because of Theorem 3.3.2 and the 
following result. 

Theorem 3.4.3 If P^^ and P are partial orders, then P c P » Z £ 

\ 

Proof : (=>) Let ^ E P 2 with g f Z , Then (Vx, y€D)(xP y =» xP 2 y A 

xP y =» g(x) ^ g(y)), so g f Z and Z = Z . (#*) Let Z = Z 

1 2 1 F 2 F l 

and suppose x and y are such that xP..y but -i (xP ? y). Then let 

the assignment g be defined by 

1 if xP„w 
8(") = ^ 

else 



□ 
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{0,1,2 



,2 




1; It li 1 






f 1 


1 


t° 


2 


i2 



lo 




V A, Y A, Y Y 




• • • 

12 



Figure 3.4,1 The lattice 



[0,1,2] 
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Now g(x) = 1 and g(y) = 0, so g (E Z . Since Z C z g jE Z 

1 2 P l P 2 

implying that for some a and b in D, aP 2 b, g(a) = 1, and g(b) = 0. 

By definition of g, xP 2 a, so by transitivity of P xP„b and g(b) 

= 1, a contradiction. n 



Theorems 3.3.2 and 3.4.3 state that the assignment functions 
I and Z are monotone decreasing functions from the lattice of 
partial orders to the power sets of the infective and zero-one 

valued assignments respectively. (Setting I. _ = (b and Z _ = 

D D D D 

({°} » {1} ) is consistent not only with the definitions but also 

with these theorems.) The next theorem follows from Theorems 

3.3.2 and 3.4.3. 

Theorem 3.4.4 

< a > I P Vp = I P ° I P ' and 
1 2 *1 *2 

(b) Z P X VP 2 " \ ° \ if P l V P 2 * ° 2 

Proof: (a) (Infective case) Let P be the set of pairs (x,y) 

consistent with every assignment in both I., and I„ ; more precisely, 

let P = {(x,y)|('Vf € I D I ) (f( x ) * f(y))}. It is readily 

*1 F 2 

verified that P„ is a partial order. Moreover, I I c I , 
3 P P P 

1 2 3 
for if f € I D I and xPy, then f(x) ^ f(y) by definition of P.. 

1 2 J 

Now P 1 E P 3 , for if xP^, then by definition of I , f(x) ^ f(y) 

for every f € I and hence for every f € I Pl I ; similarly, 
1 P l P 2 
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P s P . It follows that I c I and I £ I , so that I e I 
IS P 3 P x P 3 P 2 F 3 r x 

fl I and I = I H I . it remains only to show that P = P v P„. 
P 2 P 3 P x P 2 3 l z 

Since P. c P„ and P 2 c P have already been proved, let P, be such that 

P = P, and P = P T hen I c I and I c I whence I e I 

1 ^ z 4 4 1 4 2 4 1 

fl I^ = I^ and P 3 = P 4 . 

(b) (zero-one case) Let P = {(x,y)!(Vf € Z fl Z )(f(x) ^ f(y))} 

J ^1 *2 

Now P~ is certainly reflexive and transitive, with Z H Z s z . 
J F l *2 *3 

If P_ is not antisymmetric then for some x and y in D, x ?ty but 



f(x) = f(y) for all f in Z fl z . This can only happen if xP..y and 

12 2 

yP 2 x or yP.x and xP 2 y; in either event, P.. V p = D . The remainder 

of the proof parallels the proof for the injective case. O 

Theorem 3.4.4 suggests that sets of partial orders exhibiting 
closure properties under supremum may be useful. 

Definition 3.4.5 A subset F of is a filter of C> D if, for all P € F 
and all Q 6 P V Q f F. Alternatively, F is a filter if, whenever 
P is in F and P S Q, then Q is in F. 

Example 3.4.6 The sets 




*0 . 10 



□ 



0,1,2} 
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i; ■', v. a, , v, ii 1 1 i i ■-« 



n 



are all filters of .the lattice 0, shown in Figure 3.4.1 

Definition 3.4.7 If I is a set of injective assignments, F(I) = 

[P € I I e 1} ; if Z is a set of zero-one valued assignments, 

F(z) = {p € D |z p = Z). D 

Theorem 3.4.8 For any set of injective assignments I, F(I) is 
a filter. Similarly, for any set of zero-one valued assignments 
Z, F(Z) is a filter. 

Proof : Let P € F(I) and Q <= D> Since P £ P V Q, I pv £ L£ I 

so P V q € F(I). The proof for Z is similar. D 



The set of generators of a filter is merely its set of minimal 
elements. 

Definition 3.4.9 The set of generators of a filter F is the set 

G(F) = (P € f|(Vq C F)(Q £ P => Q = P)}. 
If G(F) is a singleton { P} , then F is said to be principal . 
The principal filter generated by P is written (P). □ 



63 



The connection will now be made between filters and sets of output 
assignments. It will be shown that for any comparator network C on D, 

C(I_) = U I p 

P€F(C(lJ) 

C(Z = ) U Z p 
P€F(C(Zj) 

The injective case is easily resolved; Theorem 3.3.1 guarantees that 

c(i_) = U i p 

P£p p 

for some family of partial orders P. Certainly P c F(C(I_), and since 
P € F(C(lJ) =» I p ^ C(I = ), 

C(IJ = U I p 
P€F(C(IJ) 

The situation for zero-one valued assignments is not so simple. 
First note that the set of zero-one valued assignments C(Z_) that 
can appear at the output of a comparator network C can be described 
in terms of C(I_). This is by virtue of Theorem 3.1.3 and because 
the set of all zero-one valued assignments on D is just the set of 
thresholds of the set of all injective assignments on D. Hence 



c(zj = e (C (ij) = p y p e ( i p ) 



for some family of partial orders P. The next theorem relates I p and 
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Theorem 3.4.10 If P is a partial order, e (I p ) = Z p . 

Proof : Let g € 8(I p ), so that g € 9(f) for some f (= I p . If f(x) ^ 
f(y) then g(x) < g(y); since f € I p , xPy =» f(x) £ f(y) and g € Z p . 
Conversely, let g € Z , and without loss of generality let the range 
of the assignments in I be the integers. Certainly I contains some 
assignment f with range ( 0,1,2,. . .n-1] (where D has n elements) so let 
h be the assignment defined by h(x) = f(x) + n.g(x). Now h is injective, 
for if h(x) = h(y) then h(x) = h(y) (mod n) so f(x) = f(y), implying 
x = y. Moreover, h is an element of I , since xPy =* f(x) ^ f(y) A g(x) 
^ g(y). Since g(x) = 1 iff h(x) > n, g € 9(h) = 9(1 ). Therefore 



P' 

p/ 5 - -p. — V-p/ "p* 



g f 6 (I„) ° g € Z„ so 8(1,) = Z p . 



Theorem 3.4.10 and the remarks preceding it imply that 

C(Z_) = U Z 

POP 

Since P C F(C(Z = )) obviously and P <= F(C(Zj) =» Z p £ C(Z = ), 

C(ZJ = U z p 

PfF(C(Z = )) 

The foregoing discussion is recapitulated in the following theorem. 
Theorem 3.4.11 For any comparator network C, 

C(IJ = U I p 

p€f(c(iJ) 

and 

C(Z = ) = 9(c(I = >) = I J Z p 

P€F(C(Z_)) D 
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The next theorem deals with the cases 1=1 and Z = Z . 

Theorem 3.4.12 F(I ) = F(Z ) = (P) 

Proof : Let Q € F(I p ); then I S I p and P £ Q, so Q € (P). If Q € (P), 

then P E Q, I E I , and Q f F(I ). The proof for Z is entirely similar. H 



As an immediate consequence of Theorems 3.4.11 and 3.4.12, we have 



Corollary 3.4. 13 . For any partial order P, 



F(C(IJ) = (P) « C(I_) = I T 



F(C(ZJ) = (P) « C(Z = ) = Z p . 



n 



Theorems 3.4.10 and 3.4.11 and Corollary 3.4.13 provide the raw 
material for Theorem 3.4.14. 

Theorem 3.4. 14 . For any comparator network C, if F(C(I_)) = (P) for 
some partial order P, then F(C(Z_)) = (P) as well. 



Proof : If F(C(IJ) = (P), then C(I = ) = I and C(Z = ) = 9(C(IJ) = 
9(I p ) = Z p , so that F(C(ZJ) = (P). 



n 



The converse of this theorem is false, and the example below demonstrates. 



Example 3.4. 15 . For the network of Example 3.1.6, namely 



a 

b 
c 
d 
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the corresponding filter F(C(I_)) is 



a 

b 

> c 

d 



I 



a b 




This filter is not principal; it is generated by the last two elements 
listed. F(6(C(I_))), on the other hand, is principal and is generated by 



M 



n 



In general, then, F(C(I = )) and F(6(C(I = ))) are different filters 
with different generating sets. They are not totally unrelated; the 
filter F(9(c(I_))) always contains the filter F(C(I_)). 

Theorem 3.4.16 F(I) £ F(8(l)) for any set of injective assignments I. 



Proof : If P € F(I) then I e I, implying Z p = 9(I p ) C 0(1) and 
P € F(9(I)). 



D 



When F(C(I_)) is principal, this fact can be determined by applying 
Theorem 3.3.3 to any family of partial orders P such that 

c(i = ) = U i p 

pfp 
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If F(C(I_)) is not principal, it is not clear how to obtain the 
generators of the filter without first constructing the entire 
filter. The generators of F(C(Z_)) may be obtained in an easier 
fashion from any product of sums expression for Z. 

Theorem 3.4. 17 Let E be a product of sums expressions for the 
characteristic function of C(Z_) in the form specified by Corollary 
3.2.5, so that 



m r- 

E .m(rr * ± > + ( oi 

Let E be the equivalent expression defined in Theorem 3.2.9, so that 



r 
A / 

E = L ~- 



R£& (p,q)PR 



(x ' + x ) 

p q 



where (t^ is a family of binary relations R with R H(A, X B, ) a singleton 
for k = 1,2,. . .m. Then every member of F(C(Z_) contains some R f &\. 



Proof : Let P be a member of F(C(Z = )), so that Z c C(Z = ). Then any 
expression describing the characteristic function for Z_, and in parti- 
cular the expression E_ given by 



e p = | | cy + x q ) 

(P,q)eP 
implies E; that is, if E^ evaluates to 1, so does E. It will be shown 
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that P D (AXB ) is nonempty for k = l,2,...m, implying R c P 
for some R € (K - Suppose P fl (A XB ) is empty for some k. Let g 
be the assignment 



g(w) 



1 if (3a € A^) (aRJ) 



else 



First, g f Z ; if this were not so, there would exist x and y such 
that xPy, g(x) = 1, and g(y) = 0. But if g(x) = 1, aPx for some a £ A fc ; 
by transitivity of P, aPy and g(y) = 1, a contradiction. g(a) = 1 
for every a f A, by definition of g, but g(b) = for every b <= B k ; 
if this were not so, then P fi A Xb, would be nonempty. Now E p evalu- 
ated at g is clearly zero, since its k term is zero, so E evaluated 
at g is zero, a contradiction of the fact that E p implies E. Hence 
R G P for some R f $* . 



□ 



The statement of the theorem is much more cumbersome than its 
application in practice. 



Example 3.4.18 Consider the network shown below. 



a 

b 
• c 
-d 
■ e 

-f 
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One expression for the characteristic function of the zero-one valued 
outputs C(Z_) is 



E = (x'+x,)(x'+x,)(x'+x )(x'+x,+x ) 
a b a da e d d e 

(x'+x*+x )(x'+x 4 -)(x'+x.)(x'+x < .) 
b e cb fc re f 



According to Theorem 3.4.16, any partial order in F(C(Z_)) must contain (a,b), 
(a,d) , (a,e), (b,f) , (c,f) , (e,f) and one element from each of the sets 
{ (d,b), (d,e)} and { (b,c) , (e,c)} . That is, any partial order inF(C(Z_)) must 
contain one of the four partial orders 

a » a fK a 







Since none of these partial orders is contained in any other, they are 

the generators of F(C(Z = )). 

Note that if there is no partial order containing a relation 
R£ ^H then that R may be discarded for purposes of finding the 
generators of F(C(Z_)). This will occur if the expressions for 
C(Z_) gives rise to relations R whose transitive closure is not 
antisymmetric. An example is the expression 



e = (x^)(x; + x a+ K c )(x; +Xc ) 

which describes the outputs of the sorting network 



a 

b 
c 



70 



albeit not minimally. It also may happen that for some R and R* in 
the smallest partial order containing R also contains R'; in this event 

R may be discarded. 

i 

The results of this chapter indicate two things: first, that 
zero-one valued assignments are usually more convenient than injective 
assignments as a tool for characterizing output behavior; and second, 
that sets of assignments described by single partial orders are parti- 
cularly simple to work with. Chapter 4 explores further the properties 
of sets of assignments described by single partial orders. 
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CHAPTER 4 
OUTPUTS CHARACTERIZED BY A PARTIAL ORDER 

4.1 Sorting Injective Assignments with respect to a Partial Order 

It is easy to show that for any partial order P on a finite domain 
there exists a comparator network such that all possible injective 
outputs of the network are sorted with respect to P; sorting with 
respect to any total order containing P will suffice. Perhaps not 
so obvious is the fact that for any partial order P there exists a 
comparator network such that C(I_), the set of possible injective 
outputs of the network, consists of exactly those assignments that 
are sorted with respect to P. A lemma will be useful for establishing 
this result. 

Lemma 4.1.1 Let P be a partial order on D with x and y elements of D 
such that —i (xPy) and — i (yPx). Let the set X be 

X = {a £ DlaPx A -i (aPy)l 
Now, X is nonempty since x € X, so let cc be a P-least element of X. Next 
let the set Y be defined by 

Y = {b c D|yPb A -, (ocPb)} 

Y is nonempty because y € Y, so let p be a P-greatest element of Y. Then 
P , the smallest partial order containing P and the ordered pair (cc,p), 
is contained in both 
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P„ , the smallest partial order containing t . p.n a nd (cc,(3) 

where TT is the permutation (Ct, P) , and 
P , the smallest partial order containing P and (x,y). 



For example, if P is the partial order 






/ 



V 



with x = 4 and y = 1, then (X, = 2 , = 1, 



P. is 



P., is 




and P is 



• 



4 
41 

3 
*5 
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(remember the "higher is smaller" convention for partial orders.) 

Proof : To show P. ~ P it suffices to show P G P„. Let aPb. 

Case 1. a = a. Now b 4 p, because CCPp contradicts p € Y. Therefore 
pP 2 b, and since 0tP 2 p, ap b, i.e. aP 2 b. 

Case 2. a = p. Now b ^ a, because if PPCC, then aPx and yPP would imply 
yPx. Since p is a greatest element of Y, either b = p or apb. In either 
event pP 2 b, i.e. aP 2 b. 

Case 3. a 4 a, a 4- p, b = a. Then since a is a least element of X, aPy; 
and since ypp, aPP and aP 2 0C, i.e. aP 2 b. 

Case 4. a ± 0c, a 4 P, b = p. Then aP 2 CC and since ap p, aP 2 P, i.e. aP b. 

Case 5. a 4 d, a / P, b 4 <*, b 4 P. Then aPb implies aP 2 b. 

To show P 1 - Po, it suffices to show that CCP p. But since aPx and yPp, 
aP x and yP„p; since xP y, aP p. 

Note that <XP_P but -i (aPp); in fact, it is not difficult to show 
that Pj =PU {(CC,P)}, so that P.. contains exactly one more ordered 
pair than does P. D 

From this construction it is easy to see how to obtain any set of injec- 
tive assignments of the form I p as the set of outputs C(I_) of some 
comparator network; in fact, it is possible to construct a network 
that transforms any I into I , as long as I contains 1^. 
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Theorem 4.1.2 If p and are partial orders with P ^ then there 
exists a comparator network which transforms I into I . 

Proof : The proof is by induction on the number of ordered pairs in Q-P. 



Basis: Tf Q-P is empty, then = P, I = I , and a vacuous network 
x r , > ' ' Q P' 

suffices . 



Induction Step : Suppose a comparator network exists to transform T to 
I as long as Q-P contains n. or fewer ordered pairs, and suppose Q-P 
contains n+1 ordered pairs, one of which is (x,y). Apply the comparator 
"^CCjfP" determined by Lemma 4,1.1 to I ; by Theorem 3.3.4, this comparator 
transforms I into I L I , where P, is the smallest partial order 

1 t -j t .-, 1 

containing P and (c:.,[3), and P., is the smallest partial order containing 

(ap)-p. (ap) and (Cf,(3). By Lemma 4.1.1, P <= P ? , so I E I and T 

i - P 2 F^ 

is transformed by <tx,3> io.to I . Since (x,y) is a member of Q and P - Q, 

1 
Q contains P„ , the smallest partial order containing P and (x,y). 

Since Lemma 4.1,1 ylso Guarantees P-, ^ P., P, r 0. Now since ccp, 13 but 

1 3 1' 1 

-- (C1PJ3) , Q-P., has a or fewer elements, so that by the induction hypothesis, 

I can be transformed to I by some comparator network. It follows that 

P l Q 

<G,,|3> concatenated with this network transforms I into I . D 

Repeated application of the induction step In the theorem will give 
rise to a comparator network that transforms i D into I and that contains 
as many comparators as there are ordered pairs in Q-P. In particular, 
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if P is the identity relation on D and Q is a total order, the resulting 
network will be a sorting network containing („) comparators. Such a 
network is inefficient, but it has the interesting property that at any 
stage, the injective assignments that can appear (and, because of Theorem 
3.4.14, the zero-one valued assignments that can appear) are characterized 
by a single partial order. 



Example 4.1.3 The sorting network 



b 
c 
d 



conforms to the inductive construction of Theorem 4.1.2 for the sequence 
of partial orders 



• • • • 

abed 



*b , 4h V c »d , «4> 1c >d , 





d , 



Lemma 4.1.1 and Theorem 4.1.2 are not the only ways to guarantee a 
single partial order at each stage; a lemma dual to lemma 4.1.1 can be 
established which guarantees that the partial orders P.. and P„ described 



in Theorem 3.3.4 satisfy P„ 



P- . An inductive argument similar to 
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Theorem 4.1.2 but employing either lemma in the induction step would 
give rise to a broader class of networks than those derivable from 
Theorem 4.1.2. 

It is sometimes possible to transform I„ into I by sorting I„ 

f p Q J & p 

with respect to a partial order S. 

Theorem 4. 1.4 Let P and S be partial orders on D, and let C be a 
comparator network so that 

1. C(I = ) = I g 

2. (Vf e I g ) (C(f) = f) 

3. C(I p ) = I p 

Then C(I p ) = I p n l s = i pVg . 

Proof : By statement 3, C maps I into a subset of I ; by statement 1, 
C maps I into a subset of I . On the other hand, C maps I f~l I onto 

if o Jr o 

I p H I by statement 2. Hence C maps I onto I H I , which is equal 

to I v by Theorem 3.4.4. 

[Gale and Karp] have developed a necessary and sufficient condition 
for statement 3 to hold when S is a partial order whose maximal chains 
are disjoint and C is a standard form network that sorts according to 
the maximal chains of S. Before stating Gale and Karp's result, a 
definition will be useful. 

Definition 4.1.5 Let P be a partial order on domain D. For any 
element x of D, the sets xP and Px are defined as follows: 

xP = {y € D|xPy] 

Px = (y € D|yPx} O 
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Theorem 4.1.6 [Gale and Karp] Let C be a standard form comparator 
network such that C(I_) = I„, where S is a partial order on D with 
maximal chains disjoint. Further, let P be a partial order on D. 
Then C transforms every element of I into an element of I iff 

1. S U P is antisymmetric; 

2. If xPy then for every set B c yS U Sy with |b| = |syj there 
exists a set A £ xS U Sx with U| = |Sx| such that every 

element of A is P-less than some element of B. ~ 

[Liu] has extended this result by showing that if C is a 
comparator network satisfying the hypothesis of the theorem and if 
condition 1 of the theorem is satisfied, then C(I p ) is a set I such 
that Q, the largest partial order satisfying I £ I , is equal to 
S V P 1 , where P' is the partial order consisting of all those ordered 
pairs (x,y) from P that satisfy condition 2 of the theorem. It is 
readily shown that the largest partial order Q such that I E I 
is just n (F(I)), the intersection of all of the partial orders in 
the filter F(I). The key fact that makes this construction possible 
is the fact that S has disjoint maximal chains; if this were not 
the case, then there might exist two networks which have a different 
effect on I even though both networks sort with respect to the 
same partial order. 



Example 4. 1. 



!C two npt:w. 



J L 



a 
b 



both sort with resruo 



am ax order S ■.■:Lth ordering diagram 



Let P bo the. 



'larcir.j o 



'1 orQeri.Tiii c'.i. a.^rraiT' 



Tlu 



network sorts everv 



'A 7 1 i >:i I L- <'-'. 



as the right- hand 



Lin view or too ,v. 
generalize the re; ; ;i!t 
case where o eh .-^3 ooi. 
more about the Mian- 
to S. 



s nroh; 



•' rot possible to 
or Liu i. o rieal with tiie 
h dis ::>!.'■ t without sped f : yiag 
uetwo'h' C that sorts with respect 
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4.2 Real-valued Assignments and Convexity 

In this section, we will consider assignments whose range is 
the set of real numbers. It will be appropriate to refer to such 
assignments as vectors in real n-dimensional coordinate space R . 
One reason this is convenient is that if a comparator <i,j> on 
the domain D = {0,l,...n-l} is applied to a vector in R , then 
the effect of the comparator can be described by means of a hyper- 
plane m R . 

Definition 4.2.1 . For any two distinct elements i and j in [l,2,...n], 

let H. . be defined by 
xj 

H. . = {v€R n |v.-v. =0} G 

xj ' J i 

H. . is certainly a hyperplane (i.e., an n-1 dimensional subspace) of 
R . By the projection theorem, any element u of R can be written 

uniquely as a sum u = v + w, where v is an element of the hyperplane 

_L 

H. . and w is an element of H. . . (Recall that if H is a subspace 
xj ij 

of vector space V, H is the set of vectors of V such that the inner 

product of any element of H and any element of H is zero). From the 

definition of H. ., H. . is the subspace 
xj' xj 

H. . = (w € R n |w. + w. = A (Vk) 
xj ' i j 

(k = i V k = j V w = 0} 
Now, an element u in R lies on the positive side of H. . (u.-u. ^ 0) 

XJ j 1 

or on the negative side of H. .(u.-u. ^ 0) or possibly both; the side 

xj J x 

of the hyperplane on which u resides is determined by the sign of 
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u -u . Notice also that if u -u. is positive, the comparator, <i,i-' 

J i 1 ! 

has no effect on u, whereas if u.-u. is negative, the comparator 

J I 

<i,i> interchanges u. and u.. If u is written u = v+w with v c II. . 
and w f H. . , then clearly v. 



u.+u. 
v . = l J and 

i ~ — 



u.-u. 

_J: 1 



u.-u. 
_J i. 



If u lies on the positive side of H. . , the comparator transforms u = v-fw 
into u' = v+w; if u lies on the negative side of H. . , the comparator 



transforms u = v+w into u 
vations. 



Tlieorem 4.2.2 sums up these obser- 



Theorem 4, 2. 2 . I! - '1 , ; 
and u is any vector in 1 
<i,j> transforms u into 



comparator on the domain •' l,2 3 ...n 



with u -- v+w, v r H. . , and w c H. . , then 



Y.7 ^ V<7 



v + ( s i gn w , ; w 



n 



The transformation perfonr.ee! by a comparator is nonlinear. In essence, 

the comparator <i , j "-' "reflects" every vector u to the positive side of 

H . It would seem plausible that a comparator network would at least 
ij 

transform the set K into a convex sec; the remainder of this section 
will consist of a proof that this is true if and only if the comparator 
network maps R onto the set af vectors consistent with some partial 
order. 
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Theorem 4.2.3 The set A of real vectors that can appear at the output 
of a comparator network C is convex iff A = A for some partial order P. 

Proof : («4=.) if A = A p for some partial order P, i.e. if 

A = {u € R n |(Vi,j)(iPj => u. < u.)} 

then for any two elements u and u 1 in A and for any X, ^ \ ^ 1, the 

vector Xu + (1-X) u 1 is in A, since if iPj , then u. ^ u. and u' ^ u 1 ; 

i J i J 

since both X and l-\ are positive, \u. ^ \xi. and (l-\)u! ^ (l-\)u'. 

i J i J 

This means that \u + (l-X)u' ^ \u. + (l-\)u!, so \u + (l-X)u' 

is an element of A. 

( =* ) Let A be a convex set, and let P be the set { (i, j) | <Tu € A) (u.-u. s 0)} 

P is obviously reflexive; P is antisymmetric because A contains 

injective assignments. P is transitive because if u -u ^ and 

J i 

U k~ U i ^ °' then u k" u i ^ °* Thus p is a partial order. Now A £ A , since 
iPj implies u^ ^ u for every u ? A, so it remains to show that A = A. 

Now A and A are surely nonempty since A is the set of possible 
vectors at the output of C. In fact, A contains injective assignments; 
according to Theorem 3.3.1, the set I of injective assignments of A can 
be written 



i = U i_ 
T6£7 T 

where each T is a total order. It is also true that I , the set of 

injective assignments in A , can be written 

i p - u i T 

e pSp l 



and since A c A , I ^ I . Moreover, since I c - I for all T fy, 
I £ I p and P S T for every T £&?. It will be shown that P £ T =* 
T €t/; this will imply I = I, Z p = Z, and finally A = A. 

Let P - T with I $izs, and let u be an assignment vector in 

I„ - Ip~I with every component u, a distinct power of 2. In particular 

th i 

let the j" smallest component of u be 2 J , j = l,2,...n. Select any 

_c*— / 
total order T' l ~<^y , and let v be an assignment vector in I , ^ I 

n th 

with every component v. a distinct power of 2 , so that the j smallest 

component of v is 2: J , j = l,2 5 ...n. 

By construction, u '-' A -A and v c A; since A is convex, every 

vector w = Au + (l-A)v belongs to A for all \ in the interval ^ ^- ^ 1 ; 

but w belongs to A only Lor certain values of A. Since A is convex, 

the collection of thesp A forms an interval ^ A -- \ n or < A ^ A- 

(J 

for some A . x = ..„u --, (1-A )v is not injective; if it were, then 

letting T denote the total order such that x ~ I T , every vector within 

some small neighborhood .'. ■' x also i/ould belong to I . Since this small 

neighborhood would inciud.- both vectors in I and vectors in I ~I by 

definition of A I wouh be a. subset of both I and I_-I, a contradiction. 

Therefore x. = x. for some vnir i,i with i 4 j - It will be argued that 

this cannot occur for vaore i)v.ui one such pair. 

Suppose x. ~ y. , and x, - x ,. . with i T ~> . k 4 I , and f i , i } f ; k ,<x. 
i i ■■: x, ■ ' J - ' 

T h en A u. + (1--^) v. ^ ,: Q ; ] i ■ l-. () )v . and .y^ -r d-A.^ = A^ + 
(1-A~)v . Solving these equations lot \ yields 



(v.-v. ) (v„-v, ) 



'0 ( V .- Vi )-( U .- U .) " ( vr v k )-( Ur ii k ) 



or 



i ( u , -u , ) (u rv j 

_L = i ] — i_ = l _ — k — 1<_ 

X Q (v.-v.) (v r v k ) 



whence 



(u . -u. ) (v , -v . ) 
1_L_ = J L_ 



Now either - — ' -,- 1^1, so that 

| (u rV ) I 



.,2 (u.-u. ) ,,n 2 



2 -2 ! - Z k i 2 ~2 



(u.-u.) | 



or - — r ) ^, 1 , implvin"- 

I (u r u k ; ! - 



n n | .'n.-'O ! 



5 ! 



i 



2 n -2 ' (u ,e" u k'' ' 



i i ' h 

it remains to be shown that j ■—■-*— — -- 1 lies outside these intervals. 

! iv r v fc )| 

First, consider the case in which max (v.,v.) = max (v/,,v, ). In this 

] i Xj k 

case, it can be shown that 
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9 



2 n -2 n 



'.v.-v.) ! 

.' v ,-V, ) ! 



9 n _ 9 n 



V - _9 



n. -n 



Since 



2-2' 



,n „n -n 



2 2 
n 4 n. ri 2 n n 
-4-2 ~2 -+4-2 



2 
,n +u 



2 2 
n n n -n 
■ J ■ l - 1' i. 



is les.j than 1 tor n >- 3. 



2 n -2' 

2 n -2 



,n ,.,11 -n 



_ _ 
,,n ~n 



and from the bounds previously found 



(u . -u. ) 

(u r u k ) 



i,v , -v , .) 



! "7 



v,,-v, ) 



Now suppose raax(v.,v. ) £■ raax(v,,v ), 



Then it can be shown thai 



(v.-v.) | 
1 i ! 



n „n 



(v„-v ) 

~ K 



If max (v. ,v. ) '"* rnaxi'v , ,v, ) 
] T- >'< k 



i (v r v k ) J 



if ir.ax('. 



maxiv, ,v i 



Since 
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2 2 -2 


2 n -? n " n 


2 n -2 


2 
? n ~ n -? n 



2 n -2 n ~ n 



2 n - 2 .2 n " n -2 2n +2-2 n 



is greater than 1 for n ^ 3, 
2 



2 n -n_ 2 n 



2 n -2 n _n 



< 



2 
2-2 

2 n -2 



2 2 
2 n -2 < 2 n -2 n " n 
' 2 „ 2 



2-2 



2 n -n_ 2 n 



and once again 



( yV i , ( VV 



(v,-v. ) 



4 V 



so that 



(u.-u.) 

(u J e"\ ) 



< v i"V 



The foregoing argument establishes that x lies on exactly one hyperplane 
H .. As a result, there exists an ^-neighborhood N_(x) of x such that for all 
y in this neighborhood, y is in A if the signs of y ^ and Vj-v t agree, and 
y is in A -A if not. Without loss of generality, let v -v ± < 0, so that for 
all y € N (x), y f A if y < y and y € A p -A if y > y . Since there 
exist vectors y satisfying this latter condition, iPj is false; by definition 
of P, there exists a z € A so that z. > z . A diagram of the situation is 



shown in Figure 4.2.1 
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Figure 4,2. ] 



■ ir'Kti ion rcsu!ti'i« from the assumption I - I £ i. 

P 



A contradir tion will iu: ""ache;; h\ showing tb-?t dierp exists a y '"-' A so 
that some point: y' on the line segment joinin'; y and 7 through x does 
not lie in A. Since A Is convex, this is impossible, so the selection 
of u was impossible and P j' -*■ {' <■-£/, I.e. ' ■=- r^. it remains 
only to find y and y'. 
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Let CC denote the distance between x and z, i.e. 



a = x-z 



n 



i=l 



(x.-z.)' 



1/2 



and let 



Now 



y = (l +^ )x + ( — ), 



x-yll =H - (^ )x + ( ^ ) Z [I =^ (U-x| 






o y € N c (x). Since x . =x . and z. ^ z . , y. < y. and y c A. On the other 



i J 



J' i '3 



hand , 



y' = (i - ~ )x + ( — )z 



20. 



satisfies 



x-y'l| = ,| (r-)x 



( ^ >* 



f !!x-z!l 


£ 


zm — 


>ct 


2 



so that y' ^ N,(x); sine 



e :-:, ---- x. and z. "> z . , y ,' > y '. and y' f A -A. But 
i J i ill P 



y' = (1- 7" )x + 



(1 ~ ^) 



(1 + -Ta) 



■m _ — ) 

9pK ' i. 



n ^ — *> 



r; - - 2 a z + < m )z 



(i - ^-) 



(1 +iz ) 



(1 + — ) 
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and y' is a convex combination of y and z, contradicting the convexity 
of A. 

It has been shown that if A is convex, I = I . By Theorems 3.4.11 
and 3.4.10, Z = 9(1) = 9(I p ) = Z , and it remains to show A - A. Note 
first that for any real number r, the vector r , defined by r. = r 
for i = l,2,...n, belongs to A. Also, A is closed under positive com- 
bination; that is, for any vectors u, v € A and any positive real 
numbers r and s,w = ru + sv € A. This result is based on the fact that 

Irs 
( — - )w = ( — ; — )u + ( — — )v is in A by convexity, and since r+s > 0, 
r+s r+s r+s J ' 

Theorem 2.1.3 guarantees w € A. Now let x £ A . Clearly 9(x) ^ Z , so 
9(x) s A. w can be written 

[n] 



w = [minfw. |i=l,2,. . .n} ] 



V 

+ / z 

z€w 
z#) n ,l n 



minfw. I z . =11 -maxf w. lz.=0} 
li ii 



[n] 

Now [minfw. !i = l,2....n}] f A. Also minfw. I z. =1} > maxfw. I z. =0} 

l i'i ii 

because z € 9(w). Since w has been written as a positive combination 

of elements of A, w € A and A - A. Therefore A = A. D 
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CHAPTER 5 
CONCLUSIONS 

The analysis of sorting networks appears to be a complex and difficult 
subject. The results of this thesis reflect the kinds of complexity 
that occur; most often, the problem is one of succinct characterization 
of the phenomenon to be studied. For example, the Boolean expressions 
of Section 3.2 are quite compact in contrast to the partial order 
theoretic characterizations of output behavior found in Section 3.3, 
but in fact these expressions are not nearly as economical as one might 
desire for a domain of eight elements, say. 

Another source of difficulty is the seeming lack of algebraic 
structure on the objects of interest: compositions of comparators, 
sets of assignments, and so forth. There is at least one significant 
exception to this generalization, however. When the set of injective 
assignments that can appear at the output of a comparator network is 
precisely the set of injective assignments consistent with a single 
partial order, then many structural regularities occur. For example, 
it can be shown that the number of injective assignments consistent 
with a partial order P is a multiple of the number of symmetries of P - 
i.e., the number of permutations n on D such that rr" • P.tt = P. Other 
examples of structural regularity arising from the single partial order 
case may be found in Section 3.4 and in Chapter 4. 
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Aside from the difficulties, there are two interesting phenomena 
that deserve mention. The first is that as a tool for network design, 
the Boolean expression characterization for sets of zero-one valued 
output assignments is much more satisfactory than the partial order 
theoretic characterization for injective output assignments. The 
manipulations required are simpler to perform, and it is easier to 
determine a minimal Boolean expression for a particular set of zero- 
one valued assignments than to determine a minimal family of partial 
orders by means of Theorem 3.3.3 in the injective case. Also, 
Theorem 3.4.14 and Example 3.4.15 indicate that sets of zero-one 
valued network output assignments are characterized by single partial 
orders more frequently than the injective output assignments are. 

The other phenomenon is that in establishing properties of 
sorting networks, it is often useful to go back and forth from in- 
jective assignments to zero-one valued assignments. This kind of 
interplay occurs in Section 3.4 and especially in the proof of 
Theorem 4.2.3. This phenomenon is probably due to the fact that 
for any injective assignment there is a unique total order with 
which it is consistent, so that the relationship between a zero-one 
valued assignment and a partial order with which it is consistent 
is sometimes best explored by finding an injective assignment which 
has the zero-one valued assignment as a threshold. 

Insofar as directions for future research are concerned, it is 
probably fair to say that no direction seems particularly promising 
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for a resolution of the outstanding open problem about sorting networks, 
namely, how many comparators suffice to construct one. It would be 
desirable to know more about the kinds of sets of assignments that can 
occur as network outputs and the kinds of sets of assignments that 
can be assignments that are sorted by a network, but it is likely 
that a successful resolution of the question of the number of 
comparators will be based on considerations as yet unexplored. 

The possibility of new techniques that will be useful for designing 
good networks for particular domain sizes is somewhat more hopeful. 
The results of Section 3.2 provide a way of exploring this area in 
an efficient manner. The idea is to start with the set Z_ and apply 
comparators in sequence to obtain sets of zero-one valued assignments 
that are progressively "closer" to a sorted set of zero-one valued 
assignments. At each stage in the construction, the degree of "closeness" 
to the sorted set could be evaluated by the number of assignments in 
the set, the form of the partial orders that generate its filter, and 
so forth. It would probably be desirable to use product of sums 
expressions for an evaluation of the "state of the sort" and sum of 
products expressions for evaluating the effect of a comparator on the 
current set of assignments because of Theorem 3.2.3. 
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